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Abstract 

Background: Depressive and anxiety disorders are common among working adults and costly to employers and 
individuals. Mental health screening is often an important initial strategy, but the resultant data are often of 
unknown representativeness and difficult to interpret. In a public sector workforce, this study used a brief screener 
for depression/anxiety to: a) compare prevalence of high psychological distress obtained from a researcher survey 
with an employer survey and population norms and b) verify whether expected correlates were observed in a 
screening setting. 

Methods: Participants were public servants working for an Australian state government. High psychological distress 
(Kessler-10 >22) stratified by age and sex was compared for a random weighted sample researcher survey (n = 3406) 
and an anonymous volunteer employer survey (n = 7715). Prevalence ratios (PR) were estimated from log binomial 
regression. 

Results: Referencing the researcher survey, prevalence of high psychological distress was greater by age and sex in 
the employer survey but was only dependably higher for men when compared with population norms. IVlodelling 
suggested this may be due to work stress (effort-reward imbalance) (PR = 3.1 9, 95% CI 1 .45-7.01 ) and casual/fixed-term 
employment (PR 2.64, 95% CI 1 .26-5.56). 

Conclusions: Depression and anxiety screening using typical employer survey methods could overestimate prevalence 
but expected correlates are observed in a screening setting. Guidance for employers on screening and interpretation 
should be provided to encourage engagement with mental health prevention and treatment programs in the 
workplace. 
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Background 

The common mental disorders of depression and anxiety 
are among the greatest public health challenges of this 
era [1]. The earlier issues such as workplace depression 
are accurately identified and treated, the sooner im- 
provements in work outcomes are likely to occur [2]. 
As a result, understanding the nature of workplace- 
based risks associated with poor mental health and 
addressing these risk factors has been an area of consid- 
erable research and practice interest. Researchers have 
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argued that employers should become involved in work- 
force screening of mental health because the data ob- 
tained can assist the development of relevant workplace 
interventions [3]. 

Despite the need for workplace action on issues such 
as depression, transfer of mental health screening into 
the hands of an employer has specific barriers and chal- 
lenges [4]. First, employers are typically interested in 
feedback systems that enable sound management deci- 
sions. However, employer surveys are usually anonym- 
ous and have volunteer samples [5] that can affect the 
validity and generalizability of findings. 

Second, mental health screening using Health Risk 
Appraisals (HRAs) has evolved from individually focused. 
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clinical settings [5] rather than work environments. Al- 
though there is some evidence supporting the use of HRAs 
in physical health promotion at work [6] there seems to be 
a gap in published information on the results obtained by 
employers who use mental health or associated measures. 
For example, despite the efforts that Great Britain's Health 
and Safety Executive (HSE) has made to develop a viable 
measure of psychosocial safety, a recent study reported 
that employers were not using the HSE Indicator Tool as 
recommended (i.e. used abridged versions, applied only 
once, substituted with other measures) [7]. 

Third, employers are realistically concerned about the 
legal implications of identifying mental health conditions 
in the workplace [8]. Therefore, to encourage engagement 
in mental health screening researchers have a role in edu- 
cating employers about how to interpret findings in view 
of: a) the limitations of the screening methods and mea- 
sures used: and b) the expected ranges given the demo- 
graphic profile of their workforce. 

A key population of interest for mental health screening 
is the public sector (also referred to as the state or govern- 
ment sector), whose employees appear to be vulnerable 
to poor mental health [3,9]. Given the large number of 
employees impacted internationally, accurate monitoring 
of the mental health of public sector employees seems to 
be an important consideration for public health. 

The mental health status of public sector workforces 
has been researched for several decades (e.g. Whitehall 
[10], WORC [3]) and has coincided with the implemen- 
tation of New Public Management (NPM) organisational 
concepts within civil services around the world. These 
reforms have led to a wide range of changes to the trad- 
itional roles of government and its associated manage- 
ment structures. Reforms have typically included the 
introduction of private sector concepts such as out- 
sourcing, rationalization, decentralization and perform- 
ance orientation [11]. 

There has been considerable debate as to whether 
organisational change has a negative impact on these 
employees [12], but evidence from public service popu- 
lations has reported increased job strain [13], increased 
presenteeism [14] and sick leave [15], and decreased or- 
ganisational commitment [13]. Public sector employees 
have been found to report higher levels of psychological 
distress than their private sector counterparts [16,17]. 
However, we do not know if these purported higher 
levels are a consequence of the different survey methods 
used, or are due to actual differences in distress in these 
working populations. In the absence of clarity on these 
issues, interpretation of whether a public sector result is 
'high' or not can be furthered by making comparison 
with working population norms for psychological distress. 
We acknowledge that population norms can underestimate 
the prevalence of poor mental health due to non-response 



bias [18] and as a result comparisons are imperfect. 
Despite their limitations, these norms can act as a third 
'best estimate' of prevalence where organisational data are 
contradictory. 

One validated way of assessing risk for depressive and 
anxiety disorders is the Kessler 10 (KIO) brief screening 
scale [19]. This 10-item scale measures 'psychological 
distress' and has acceptable performance as a screener 
for DSM-IV depressive and anxiety disorders [20]. 
Although the KIO can be used to assess the prevalence of 
psychological distress in workers, it gives no clues about 
modifiable risk factors influencing poor mental health. 
When the KIO is applied in a HRA context, it is important 
to assess whether high distress is associated with the typ- 
ical demographic, socio-economic, health, and work corre- 
lates found in other literature [10]. If the KIO correlates 
with expected characteristics this result adds evidence of 
validity to the application of the KIO for detecting high 
distress in public sector employees. 

In this study, results obtained from random weighted 
and anonymous volunteer HRA surveys using the KIO 
were compared within a large and diverse public sector 
organisation. We wanted to assess whether the preva- 
lence of high psychological distress was greater than that 
of working population norms and verify that the KIO 
results were associated with expected correlates in a 
screening setting. 

Using a researcher survey as the reference, the aims of 
this study were to: a) compare the self-reported preva- 
lence of psychological distress measured with a brief 
screener with that of an employer survey; b) determine 
whether prevalence differed to normative population data; 
and c) investigate and classify the socio-demographic, 
health and work correlates of self-reported high psycho- 
logical distress. 

Method 

Setting 

This study was based in Tasmania, which is an island 
State of Australia with a population of approximately 
500,000 people. The setting for this research was in 
the form of a partnership, 'Partnering Healthy® Work' 
(PH@W), between the Tasmanian Government and 
the University of Tasmania. The Tasmanian State Service 
(TSS) is one of the region's largest employers with ap- 
proximately 30,000 employees and incorporates a wide 
range of government departments (e.g. health, education, 
environment), occupations and locations (city-based, rural, 
remote). Since 2009, the Tasmanian Government has 
invested more than $2 million in workplace health promo- 
tion, the "Healthy@Work" (H@W) initiative, targeting 
their whole workforce. Ethics approval for the study was 
obtained from the Human Research Ethics Committee 
(Tasmania) Network (ID: H0010501). 
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Study design 

Partnering Healthy® Work is a longitudinal evaluation of 
H@W that includes collection and assembly of data 
from a range of data sources: a repeated, randomly- 
selected cross-sectional health workforce survey initiated 
by researchers (PH@W 2010 and 2013); an anonym- 
ous online employer-initiated workforce health survey 
(H@W 2009 and 2011); and human resource administra- 
tive data. This study used data from the first employer 
(H@W 2009) and researcher (PH@W 2010) workforce 
surveys, comparing it to normative prevalence data for 
the Australian and Tasmanian working populations. 

Public sector worl<force data sources 

The researcher survey was distributed in February 
2010 to TSS employees. We selected a 40% random 
population sample from the total pool of employees, 
stratified according to employment condition, employ- 
ment category and agency. The response rate was 28% 
(N = 3406). 

Survey responses were merged with an extract of 
administrative data from the TSS human resources data- 
base to permit analyses according to the key demo- 
graphic variables of age, sex, employment condition 
(permanent, fixed-term or casual), employment category 
(full-time, part-time), annual salary, job classification 
((Bands 1-3 [low], Bands 4-6 [mid]. Bands 7-8 [high/ 
manager]. Bands 9-10 [very high/ senior executive]), 
industrial award (blue collar, white collar, service, profes- 
sional, manager), tenure (within the TSS, by government 
department) and public sector agency. 

Standard survey weighting for the researcher survey 
was not possible due to very low response rates and zero 
cells in several strata. Therefore, to adjust for possible 
response bias, we applied the inverse probability of re- 
sponse weighting method described by Hofler and col- 
leagues [21] based on a model including age, sex, 
government department, employment category, employ- 
ment condition, and tenure using the human resources 
database as the reference population. 

The employer survey was made available in an 
intranet-based format in 2009 to all TSS employees. It 
was designed by the TSS using a range of pre-existing 
measures and had a response rate of 25% (N = 7715). 
This survey asked about age, sex, psychological distress 
(KIO) and a range of lifestyle factors and behaviours that 
increase the chance of developing chronic health condi- 
tions like cardiovascular disease and diabetes. Distinct 
from the researcher survey, it did not: a) measure 
broader socio-demographic information, work contextual 
factors or psychosocial variables; b) use random selection 
or population stratification procedures; and c) it was 
anonymous so responses could not be matched to human 
resources data. 



Comparative normative data sources 

We collated population normative data for workers with 
the same KIO measure of psychological distress from 
two Australian cross-sectional datasets: a national men- 
tal disorder prevalence survey, the National Survey of 
Mental Health and Well-Being (NSMHWB) [22], and 
the Tasmanian Population Health Survey 2009 (TPHS) 
[23] (Table 1). The NSMHWB had a 60% response rate 
(N =7715 workers). Weighted survey respondent charac- 
teristics indicated 50% were female, 57% were married/ 
Defacto and 37% were in the 35 to 54 years age-range. 
The TPHS had a 70% response rate (N = 3160 workers) 
and weighted characteristics showed 57% were female, 71% 
were married/ Defacto and 56% were in the 35-54 years 
age range. Data were extracted by age, sex, employment 
status (i.e. workers) and psychological distress. 

Measures 

All of the surveys sought information on employed indi- 
viduals' age and sex as well as psychological distress 
using the Kessler-10 (KIO) screening scale which scores 
in a range of 10 to 50 [19,20]. The KIO total psycho- 
logical distress score was categorized as low (10-21) ver- 
sus high (22-50) [24]. A high (>22) or very high score 
(>29) gives a strong indication of a clinically diagnosable 
mental health condition [19]. 

The researcher survey measures, which were used to es- 
tablish the correlates of psychological distress, included 
marital status (married or Defacto, not married); education 
level (up to year 10, up to year 12, post school); general 
physical health as measured by the SF-12 physical compo- 
nent summary scale [25]; smoking habits (daily smoker, all 
others) [26]; fruit and vegetable intake (inadequate, ad- 
equate) [27]; height and weight to measure body mass 
index (BMI); alcohol intake [28] (high risk, low risk) mea- 
sured using national guidelines [29]; and total physical 
activity (minutes per week) derived from the Long Inter- 
national Physical Activity Questionnaire (IPAQ) [30] . 

Preferred work hours and contractual work characteris- 
tics included days worked (Monday to Friday, days vary 
weekly, other), schedule worked (regular days, other), and 
hours worked. Other psychosocial factors were measured 
using the Effort Reward Imbalance (ERI) questionnaire, 
which is a commonly applied validated self-report survey 
with 6 items measuring Effort and 11 items dedicated to 
Reward. A ratio is calculated for every person by first add- 
ing all scores for each of the effort (e) and reward (r) scales, 
then applying the formula e/(r x c) where c equals the pro- 
portion 6/11 [31]. ERI ratio scores >1 are argued to indicate 
an imbalance of high effort and low reward conditions. 

Statistical analysis 

We first derived the prevalence of high psychological 
distress as proportions of participants with KIO scores of 
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Table 1 Data sources to compare employee psychological distress (Kessler 10] 



Survey 


Type 


Population 


Participation rate 


n 


Method 


PH(aW 2010' 


Researcher-initiated 


TSS^ employees 


28% 


3406 


Random weighted paper and pencil 


H(aW 2009^ 


Employer-initiated 


TSS employees 


25% 


7715 


Non-random anonymous online 


TPHS 2009^ 


Population normative 


Tasmanian working adults 


70% 


3160 


Random weighted telephone 


NSMHWB 2007^* 


Population normative 


Australian working adults 


60% 


5499 


Random weighted face-to-face 



'Partnering Healthy@Work. 
"^HealthygWork. 

^Tasmanian Population Health Survey. 

''National Survey of Mental Health and Weil-Being. 

^Tasmanian State Service. 



22 or greater by age and sex in the researcher and em- 
ployer surveys and the two population normative data- 
sets, using the researcher survey as the reference to 
calculate variance estimates. The differences between 
proportions were assessed by calculating standard er- 
rors using the standard normal approximation for large 
samples, and assumed independent sampling. Analysis 
was stratified by sex. This approach was taken on the- 
oretical grounds [32,33] because of known differences 
between men and women in correlates of psychological 
distress. 

Second, we used the researcher survey data for multi- 
variable model building [34] with dichotomized psycho- 
logical distress as the outcome variable. We conducted 
a univariable analysis, and selected those variables with 
a p-value less than 0.25 for further analysis. Then we 
performed logistic regression analyses, entering the se- 
lected variables one at a time and conducting a Wald 
test upon each new variable's entry to determine if 
that variable significantly (p < 0.05) increased model 
discrimination. This process selected the set of vari- 
ables that provided the best discrimination between 
low and high psychological distress. ROC values of 
greater than 0.7 and less than 0.8 model 'acceptable 
discrimination' [34]. 

Separated by sex, individual covariates were entered 
one at a time in order of demographic (age, marital 
status), socio-economic (annual salary, education, occu- 
pation), contractual work characteristics (employment 
condition, employment category, tenure, hours worked, 
days worked, job classification, schedule worked), health 
behaviours (general physical health, inadequate fruit and 
vegetable intake, daily smoker, high risk alcohol, BMI, 
total physical activity) and psychosocial work environ- 
ment (preferred hours, ERI). These classification pro- 
cesses did not permit data weighting procedures, so 
when these analyses were complete, the final sets of 
variables were used to build log binomial regression 
models by sex of the predictors of high psychological 
distress for estimation of weighted prevalence ratios (PR) 
[35]. All analyses were conducted using STATA 12.1 
(StataCorp LP, Texas, USA). 



Results 

Prevalence of high psychological distress 

The prevalence estimates of high psychological distress 
in the two Tasmanian State Service (TSS) workforce sur- 
veys are shown in Table 2, stratified by age and sex. The 
results show that the employer survey estimates of 
prevalence of psychological distress for were statistically 
different {p < 0.001) to those of the researcher survey for 
both men (5.9% higher) and women (6.4% higher). 

Using the same reference, high psychological distress 
totals were lower for male Tasmanian workers who were 
sampled in the TPHS {p = 0.013) and Australian workers 
in the NSMHWB survey (p = 0.002). Prevalence estimates 
of high psychological distress for women in the population 
surveys were not statistically different (p > 0.05) to those 
obtained by the researcher survey but they had higher aver- 
age percentages than those calculated for men. 

Within the 16 to 24 year age-group in men the differ- 
ences in the TSS surveys are also pronounced (18.7% 
[ref] for the researcher survey and 23.7% [p = 0.002] 
for the employer survey) when compared with both 
the TPHS (7.1%, p = 0.132) and the NSMHWB (6.2%, 
p < 0.001). Prevalence percentages for the employer sur- 
vey were elevated across all male age-groups. For the TSS 
surveys, the prevalence of high psychological distress in 
the 16 to 24 year and 25 to 34 year women's age-groups 
also appeared higher than in the population surveys, with 
these elevations being consistent for all age-groups in the 
employer survey. 

Correlates of high psychological distress in the public 
sector workforce 
Sample characteristics 

For the researcher survey, the average age of respondents 
was 45 years and 67% were female (see Supplementary File 
Table lA, which shows respondent characteristics for the 
Partnering Healthy@Work 2010 survey). Most respon- 
dents were married (77%), had received education up to 
Year 10 (54%), were permanently employed (90%), full- 
time (61%) employees working regular schedules (81%), 
Monday to Friday (57%). On average, respondents had 
public sector tenure of 12 years, worked 38 hours a week 
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Table 2 Prevalence (%] of high psychological distress^ by age and sex reported in surveys of Tasmanian and 
Australian employees 

IVlen%(N^) Women%(N) 
Age group (years) PH(fflW2010^ H@W 2009" TPHS 2009^ NSMHWB 2007® PH(aW2010 H@W 2009 TPHS 2009 NSMHWB 2007 



15 - 24 18.7 (16) 23.7(131) 7.1(84) 6.2 (512) 16.7 (64) 23.7 (329) 11.1(80) 11.7 (564) 

25 - 34 7.4(103) 17.3(394) 6.7(177) 9.1(467) 164(337) 22.7(1001) 9.8(256) 14.8(544) 

35 - 44 11.8 (222) 17.0(695) 74 (323) 6.5 (687) 13.2 (551) 18.1 (1329) 114(471) 10.7 (674) 

45 - 54 11.5 (373) 15.6(801) 7.8 (392) 8.8 (483) 103 (956) 16.1(1871) 10.1(585) 10.8 (555) 

55 - 64 7.1(219) 12.0 (417) 7.5 (278) 4.2 (396) 6.7 (477) 14.8 (856) 10.1(353) 7.7 (379) 

554- 0.0 (15) 20.0 (25) 2.5 (80) 34 (153) 3.8 (27) 114 (35) 94(52) 7.5 (85) 

Total 10.2(948) 16.1(2463) 7.1(1334) 6.8(2698) 11.6(2412) 18.0(5421) 104(1798) 11.2(2801) 

ref <0.001 0.013 0.002 ref <0.001 0.217 0.551 



Prevalence was measured using the K10 and dichiotomized as 'higli' versus 'low' distress with K10 scores >22 being rated as 'high'. 
^N, total number of respondents by category. 

^Partnering Healthy@Worl< 2010, researcher-initiated survey of Tasmanian State Service employees (weighted). 
"Healthy@Work survey 2009, employer-initiated survey of Tasmanian State Service employees (unweighted). 
^Tasmanian Population Health Survey 2009, population normative data of Tasmanian workers (weighted). 
^National Survey of Mental Health and Weil-Being 2007, population normative data of Australian workers (weighted), 
^p-value for the differences between total prevalence of psychological distress in the survey, relative to PH@W 2010. 



and received an annual salary of A$66,236. The weighting 
process showed that the respondents were more likely than 
non-respondents to be older, female, of longer tenure, full- 
time employees, and to have worked within specific gov- 
ernment departments. 

Univariable correlates of high psychological distress 

Men and women showed many similar univariable corre- 
lates for high psychological distress that were statistically 
significant (p < 0.05) (Table 3). Using the parameters de- 
scribed in the Methods section, marital status, state service 
tenure, health behaviours, preferred hours and ERI were 
selected for subsequent model building across both sexes. 
Although age was only significantly associated with distress 
for women, it was included in the men's model due to its 
clinical importance. For men, a unique association was 
apparent for employment category and employment condi- 
tion. Occupation, annual salary and department tenure 
were uniquely associated with high psychological distress 
among women. Furthermore, women had a significant 
association for both 'less hours' and 'more hours' in the 
preferred hours category whereas men only met the inclu- 
sion criterion for the 'less hours' category. For men, state 
service tenure was added at the conclusion of preliminary 
main effects modelling [34] . 

The variables contained in the fully adjusted model for 
men (Table 4) were classified as acceptably discriminat- 
ing (ROC = 0.77) were age, marital status, employment 
category, state service tenure, BMI, alcohol use, daily 
smoking, and perceptions of high-effort and low-reward. 
This set of variables provided the best discrimination 
between high and low/moderate psychological distress 
(ROC = .76), with independent associations being found 
for younger age, fixed- term/casual employment and the 



upper tertile of ERI. Weighted population estimates of 
high distress prevalence by ERI tertiles for men were 
5.8% (lower), 5.3% (middle) and 20.5% (upper) respect- 
ively. A 3-fold increase in prevalence of psychological 
distress was evident between the highest and lowest ERI 
categories in the resultant model. 

Among women, the set of variables providing the best 
discrimination between high and low/moderate psycho- 
logical distress (ROC = 0.75) were age, marital status, 
state service tenure BMI, alcohol use, daily smoking, 
fruit and vegetable intake and ERI were included in the 
model. Independent associations with high distress were 
found in the fully adjusted model for women who were 
younger, unmarried, and in the upper tertile of ERI 
(Table 4). Weighted population estimates of high distress 
prevalence by ERI tertile for women were 4.7% (lower), 
7.2% (middle) and 22.0% (upper) respectively. 

Weighted population estimates of high distress preva- 
lence by ERI tertile for women were similar to those for 
men being 4.7% (lower), 7.2% (middle) and 22.0% (upper) 
respectively. A 5-fold increase in psychological distress 
prevalence was identified in the highest versus lowest ERI 
categories. 

Discussion 

In this study we compared the self-reported prevalence 
of high psychological distress between two surveys of a 
public sector workforce and then with population norma- 
tive worker surveys using the same KIO brief screening 
measure. We examined whether there were differences 
in the results obtained from employer and researcher ap- 
proaches to data collection and we also investigated the 
socio-demographic, health and work correlates of high psy- 
chological distress 



Jarman ef al. BMC Public Health 2014, 14:125 
http://www.biomedcentral.eom/1 471 -2458/1 4/1 25 



Page 6 of 1 1 



Table 3 Univariable logistic regression analysis 





Men 


p 


Women 


p 


Variables 


PR' (95% CI) 




PR (95% CI) 




Age (years) continuous 


0.99 (0.98 - 1.01) 


0.355 


0.97 (0.97 


- 0.98) 


<0.001 


16-24 


1.00 


- 


1.00 




- 


25-34 


0.40 (0.12 - 1.35) 


0.139 


0.98 (.053 


- 1 .83) 


0.959 


35-44 


0.63 (0.21 - 1.87) 


0.406 


0.79 (0.43 


- 1 .45) 


0.446 


45-54 


0.62 (0.21 - 1.78) 


0.372 


0.62 (0.34 


- 1.13) 


0.116 


55-64 


0.38 (0.12 - 1.18) 


0.095 


0.40 (0.21 


- 0.78) 


0.007 


654- 


Insufficient cases 


0.000 


0.23 (0.03 


- 1.70) 


0.150 


Marital Status 












Not married 


2.00 (1.32 - 3.05) 


0.001 


141 (1.10 


- 1 .79) 


.006 


Married/Defacto 


1.00 


- 


1.00 




- 


Occupation 












Blue Collar 


1.15 (0.62 -2.13) 


0.668 


1 .24 (0.88 


- 1 .74) 


0.227 


Admin 


0.94 (0.54 - 1 .62) 


0.815 


141 (1.05 


- 1.91) 


0.023 


Service 


1.00 


- 


1.00 




- 


Professional 


1.55 (0.76 - 3.13) 


0.228 


1 .29 (0.60 


- 2.80) 


0.517 


Manager 


0.85 (049 - 1 .46) 


0.553 


1 .35 (0.92 


- 1 .96) 


0.123 


Annual Salary 


1.01 (0.97- 1.06) 


0.638 


0.94 (0.88 


- 1.00) 


0.044 


Education 












Up to Year 10 


0.63 (0.26 - 1.53) 


0.308 


0.92 (0.65 


- 1.31) 


0.653 


Up to Year 1 2/certificate 


1 .22 (0.82 - 1 .83) 


0.322 


1 .02 (0.80 


- 1.33) 


0.826 


Post School 


1.00 


- 


1.00 




- 


Job Classification 












Bands 1-3 


0.96 (0.58 - 1 .59) 


0.872 


0.92 (0.72 


-1.17) 


0.484 


Bands 4-6 


0.97 (0.51 - 1.85) 


0.930 


0.86 (0.55 


- 1 .36) 


0.518 


Bands 7-8 


1.32 (0.64 - 2.72) 


0.444 


0.56 (0.21 


- 1 .48) 


0.244 


Bands 9-10 


1.00 


- 


1.00 




- 


Employment Category 












Fixed Term/ Casual 


1.77 (1.10 - 2.86) 


0.018 


1.18 (0.79 


- 1.77) 


0.427 


Permanent 


1.00 


- 


1.00 




- 


Employment Condition 












Part Time 


141 (0.88- 2.26) 


.0156 


0.90 (0.72 


- 1.13) 


0.351 


Full Time 


1.00 


- 


1.00 




- 


Tenure 












State Service 


0.99 (0.97 - 1 .00) 


0.119 


0.98 (0.97 


- 0.99) 


<0.001 


Agency 


0.99 (0.97 - 1.01) 


0.285 


0.98 (0.96 


- 1.00) 


0.051 


Days worked 












Days Vary Weekly 


0.83 (047 - 1 .48) 


0.534 


1.12 (0.82 


- 1.53) 


0.463 


Other 


1 48 (0.89 - 2.44) 


0.129 


0.85 (0.65 


- 1.11) 


0.235 


Mon to Fri 


1.00 




1.00 






Schedule worked 












Regular day 


1 .06 (0.65 - 1 .72) 


0.812 


0.89 (0.66 


-1.19) 


0.421 


Other types 


1.00 




1.00 






Hours worked 


1 .00 (0.98 - 1 .02) 


0.881 


1.00 (1.00 


- 1.01) 


0.422 
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Table 3 Univariable logistic regression analysis (Continued) 



Preferred hours 










Less hours 


1.49 (1.00 - 2.22) 


.052 


1.39 (1.10 - 1.76) 


0.006 


Same hours 


1.00 




1.00 




More hours 


1 .26 (0.48 - 3.32) 


0.635 


1.56 (1.01 - 2.42) 


0.047 


General Health'^ 


1.01 (0.97 - 1.06) 


0.661 


0.99 (0.98 - 1 .01 ) 


0.489 


BMI (per unit) 


1.05 (1.01 - 1.08) 


0.010 


1.02 (1.00 - 1.05) 


0.038 


Alcohol Intake 










High Risk 


1.60 (1.05 - 2.44) 


0.030 


1.61 (1.21 - 2.13) 


0.001 


Low Risk 


1.00 




1.00 




Fruit & Veg Intake 










Inadequate 


141 (0.96 - 2.08) 


0.079 


1.46 (1.16 - 1.83) 


0.001 


Adequate 


1.00 




1.00 




Smoker 










Daily Smoker 


1.89 (0.99 - 3.61) 


0.053 


1 .36 (0.94 - 1 .97) 


0.105 


All Others 


1.00 




1.00 




Physical Activity'' 










Lower 


1.30 (0.78 - 2.18) 


0.318 


0.89 (0.66 - 1 .20) 


0.442 


Middle 


1.92 (1.18 - 3.11) 


0.008 


1.23 (0.94- 1.61) 


0.134 


Upper 


1.00 




1.00 




ERI tertiles" 










Lower 


1.00 




1.00 




Middle 


1 .02 (0.53 - 1 .96) 


0.950 


1.53 (1.00 - 2.35) 


0.051 


Upper 


3.54 (2.10 - 5.97) 


<0.001 


459 (3.20 - 6.60) 


<0.001 



High psychological distress prevalence ratios for men and women participating in the Partnering Healthy@Work 2010 survey. 
^PR, Prevalence Ratio using inverse probability weighting method. 
^General Health is derived from SF12 aggregate physical score. 

^Physical activity tertile ranges (minutes per week} 0-146, 147-252, 253-362 - a combination of total work and leisure minutes. 

"ERI, Effort-Reward Imbalance tertile ranges: Males = 0.21-0.36 (lower); 0.36 - 0.49 (middle); 0.49 - 2.32 (upper). Females = 0.21 - 0.36 (lower); 0.36 - 0.50 (middle); 
0.50 - 2.05 (upper). 



For both sexes, we found that the prevalence of high 
psychological distress was greater in the employer survey 
when it was referenced to the researcher survey. This 
higher prevalence was observed across all age-groups for 
the employer survey. When the researcher survey was 
compared with population norms for workers, prevalence 
of high distress was greater for men but not women. It is 
interesting that the women's researcher and population 
surveys showed strong consistency in prevalence esti- 
mates despite their differing modes of data collection 
(telephone, paper-pencil and interview) and arguably dis- 
similar workforces. 

Age-group differences in prevalence were also identi- 
fied when comparing the public sector and population 
surveys, particularly with the youngest male and female 
age-groups. Psychological distress has been found to be 
more prevalent among younger people and tends to de- 
crease as age increases [24]. Jorm and colleagues [36] 
found that problems such as job threats, personal problems 
and ending relationships were most prominent among 



younger age groups. Moreover, early working life coincides 
with a potentially stressful major developmental stage as 
adolescents move into adulthood and have to cope with 
associated adult responsibilities [37]. Recent papers have 
advocated the need to generally target younger workers 
with mental health promotion strategies [38,39] so al- 
though the age-group differences evident in this study are 
not conclusive, our results are in a direction that is consist- 
ent with other research. 

Despite previous validation of the online KIO as a 
screener for depression [40], in this study administration 
of the KIO by an employer to a volunteer sample of 
employees appears to have overestimated prevalence. 
Screening is an important component of prevention and 
treatment efforts [41] but guidance on interpretation is 
needed to prevent inaccurate conclusions about the 
prevalence of distress or where preventive efforts should 
be targeted. Furthermore, as has been found elsewhere 
[3], age and sex data make a relatively limited contribu- 
tion by themselves to our understanding of the drivers of 
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Table 4 Sequential log binomial regression models 



Men 



Women 



Variables 



PR^ 



95% Cr 



PR 



95% CI 



Demographic variables 

Age 0.97 0.94-1.00 0.016 

Marital status 1.31 0.70 - 2.48 0.388 
Job characteristics 

Employment category 2.61 1.25 - 547 0.011 

State Service tenure 0.98 0.95 -1.01 0.147 
Health-risk behaviours 

BMI 1.03 0.97 - 1.09 0.396 

Risky alcohol 1.24 0.68 - 2.26 0.479 

Daily smoker 1.86 0.89- 3.92 0.101 
Inadequate fruit and vegetable intake 
Psychosocial factors 
ERP 

Middle 0.79 0.30 - 2.05 0.624 

Upper 3.37 1.52 - 7.47 0.003 

ROC^ .7659 



0.97 
1.44 



0.99 

1.02 
1.17 
1.35 
1.27 



1.52 

5.28 



0.95 - 0.99 
1.01 - 2.05 



0.96- 1.01 

0.99 - 1 .05 
0.79- 1.71 
0.88 - 2.09 
0.88 - 1 .80 



0.75 - 3.1 1 
2.91 - 9.75 
.7559 



0.007 
0.048 



0.240 

0.143 
0.438 
0.168 
0.200 



0.246 
<0.001 



Correlates of high psychological distress for men and women participating in the Partnering Healthy@Work 2010 survey. 
VR, Prevalence Ratio; CI, Confidence Interval. 
^ERI, Effort-Reward Imbalance tertiles. 

^ROC, Area under the Receiver Operating Characteristics curve 

- Models for men and women were calculated separately. 

- Reference categories: married or defacto, permanent employment, not risky alcohol, not daily smoker, ERI lower tertile. Age, state service tenure and BMI are 
continuous variables. 

- Omitted categories, designated with a '-' identify that the variable did not make a contribution (p>0.05) to the ROC. 



worker psychological distress within organisations. It was 
a necessary step in this research setting to assess whether 
high distress, as measured by the KIO, was associated 
with expected correlates. Modelling was necessary to 
investigate this issue. 

The logistic modelling results showed that the best set 
of variables to predict high psychological distress in both 
men and women were age, marital status, state service 
tenure, BMI, alcohol use, daily smoking and ERI, al- 
though not all included variables were independently 
associated with distress. For men, employment category 
(permanent vs. fixed-term/ casual) was also important, 
while for women fruit and vegetable intake contributed 
to model discrimination but was not itself independently 
associated with distress. 

In the men's fully adjusted model, high psychological 
distress was independently associated with lower age, 
fixed term or casual employment and the upper tertile 
of ERI. High distress prevalence was twice as likely for 
men in fixed term or casual employment and three times 
more likely if they were experiencing high effort reward 
imbalance. It has historically been argued that ratio- 
nalization of the public sector has contributed to higher 
levels of psychological distress [9]. Although this public 
service had not commenced rationalization at the time 



of the surveys, lag effects of historical organisational 
changes could be considered. Men have also been found 
to be at higher risk of psychological distress in the face 
of job insecurity [42] which can be assessed through em- 
ployment category and ERI variables. Nevertheless, it is 
also possible that workers with poorer mental health are 
more likely to hold precarious temporary employment 
[43]. Further investigation is needed to establish the 
direction of effect and factors influencing men's mental 
health in this public service. 

For the women's fully adjusted model, younger age, 
being unmarried, and high ERI were independently asso- 
ciated with high psychological distress, with ERI making 
the major contribution. The results estimate that the 
prevalence of distress among those in the upper tertile 
of ERI was 20% for men and 22% for women. This find- 
ing, combined with longitudinal evidence of association 
[44], suggests that if attention is given to addressing the 
risk of effort-reward imbalance, there may be a related 
reduction in the risk of high psychological distress in the 
workplace. The reasons for the strength of the ERI con- 
tribution to the models are an area for further investiga- 
tion. As an example, Tsutsumi and Kawakami [45] have 
proposed that extrinsic efforts (e.g. overtime, workload) 
and rewards (e.g. praise, development opportunities) can 



Jarman ef al. BMC Public Health 2014, 14:125 
http://www.biomedcentral.eom/1471-2458/1 4/1 25 



Page 9 of 1 1 



be a focus of organisational interventions to overcome 
imbalance. Few interventions have yet been developed 
based on improving ERI but early attempts show promise 
(e.g. [44]). 

Overall, the models presented here suggest priorities 
for mental health intervention would include men in 
fixed-term or casual employment, younger workers and 
those experiencing high Effort-Reward Imbalance. Re- 
sponses based on randomly sampled, weighted data iden- 
tified correlates of high psychological distress that are 
reasonably consistent with other international studies, 
and provided direction as to sub-populations needing tar- 
geting through workplace mental health promotion strat- 
egies. These findings provide support for use of the KIO 
as a brief screening measure of psychological distress 
within an organisational context, providing appropriate 
guidance on interpretation is available. 

Limitations 

These study implications need to be examined in view of 
several limitations. First, participation rates were below 
30% for both of the public sector surveys, though these 
rates are typical for the field [3]. A key strength of this 
study is the use of weighting procedures to help control 
for response bias in the researcher survey. In compari- 
son, the employer survey was unweighted and may not 
have provided a reliable indication of psychological dis- 
tress prevalence in this public sector workforce. Second, 
it is possible that the differences in survey data collec- 
tion methods are biasing the results. However, Mealing 
and colleagues have argued against this position [46], 
finding that relative risk estimates were consistent for 
studies of the same population with different methods of 
data collection, response rates and sampling methods as 
long as survey questions were the same. A recent study 
has also found no significant differences between re- 
sponse rates, or types of responses to questions whether 
surveys were perceived to be anonymous or not [47]. 
We acknowledge that the population studies we have 
used as comparators may have underestimated the 
prevalence of psychological distress due to non-response 
bias [18]. However, we required points of adjudication 
because the workforce survey results were conflicting 
and these norms were the best estimates available. Third, 
this study is cross-sectional and the direction of relation- 
ships cannot be established. Kolstadt and coworkers [48] 
have also suggested that reporting bias can inflate associ- 
ations between self-reported job-strain and depression, 
and a work unit analysis may show weaker associations 
than those found here. Finally, there is room for improve- 
ment in the types of measures applied in this study. For 
instance, our study used the socioeconomic variable 
'annual salary' as a proxy measure for income, which may 
be an underestimate for occupations with allowances 



and overtime (e.g. police, nurses). Future measurement 
of additional contextual measures also seems likely to 
strengthen our understanding of the variables discrimin- 
ating high from low psychological distress in public sector 
workforces. 

Implications for practice: how should these findings 
be used? 

After the employer survey was conducted, this public 
sector organisation acted on the findings by implementing 
a mental health promotion strategy that was predomin- 
antly focused upon general education about mental health. 
The impact of this approach is yet to be determined as 
follow-up data collection is underway, but this study sug- 
gests a greater reduction in risk may be obtained if specific 
sub-populations with poor mental health (i.e. men and 
younger workers) and people with high effort-reward im- 
balance are targeted. Anonymous, volunteer surveys of 
worker mental health may be resource efficient and pro- 
mote participation but this example suggests they may 
not advance management decision-making. Health Risk 
Appraisals for risk reduction rely on valid assessments of 
health outcomes. Inaccurate results could lead to expen- 
sive resource allocation that is ineffective in reducing the 
risk of poor mental health in the workplace. In addition, 
mental health screening may also only be of limited use 
without the collection of at least some of the known im- 
portant correlates (e.g. individual characteristics, psycho- 
social factors) to allow specific targeting of interventions. 
Clinicians have an important role in educating employers 
about mental health screening and giving advice on health 
survey interpretation. 

Conclusions 

Understanding the nature of workplace-based risks asso- 
ciated with poor mental health and addressing these risk 
factors is a pressing public health issue. Depression and 
anxiety screening forms part of a response to this chal- 
lenge but this study showed that screening using typical 
employer survey methods with a validated measure could 
overestimate prevalence. Depression and anxiety screening 
should be promoted to employers and employees but guid- 
ance is needed on interpretation. In identifying priority 
groups for intervention, perceived work stress and a fcced 
term/casual employment contract may be particularly im- 
portant among men. 
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